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A REMOTE BAGGAGE SCREENING SYSTEM, 
SOFTWARE AND METHOD 

5 CROSS-REFERENCE TO RELATED APPUCATIONS 

This application claims priority under 35 U.S.C. § 119(e) to commonly-owned, 
co-pending U.S. Provisional application Serial No, 60/281,068, entitled '^Remote 
Access Server," filed on April 3, 2001 (not published). 

10 ' ' BACKGROUND 

1. Field of the Invention 

The present invention relates to a method and system for screening items of 
baggage or packages which may be used, for example, in airports. 

15 2. Discussion of Related Art 

Particularly at airports, it is often necessary or desirable to screen passenger 
baggage for potential threats or contraband items. In light of recaat terrorist activities, 
it is becoming more important to accurately screen baggage. However, with increasing 
air traffic, it is also becoming more necessary to expedite the screening procedure to 

20 avoid long delays. Conventional systems for passenger baggage screening at airports 
use separate departure screening, for explosives, we^ons, etc., and arrival screening 
for contraband items such as currency or drugs on intemational flights. Therefore, 
conventional systems require at least two baggage screening systems - one at a 
passenger's point of origia, a second at the passenger's destination, and possibly 

25 additional systems at any intermediary stops between the passenger's point of origin 
and his/her destination. 

Such baggage inspection systems include X-ray imagmg systems, which may 
employ transmitted and/or scattered X-ray radiation, vapor detection systems, magnetic 
resonance imaging systems, and other types of inq)ection systems. The X-ray imaging . 

30 systems incorporate an X-ray single or dual energy source and a scanning system to 
scan the object to be inspected with and X-ray beam produced by the source. Some 
systems use a smgle-view source and detector arrangement, while others utilize a dual- 
view or multi-view arrangement. The single-view or dual-view systems usually scan 
baggage as it moves on a conveyor, using a fan beam or scanning pencil beam of X- 
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rays to provide projection images. The multi-view, CT-type systems generally scan 
stationary baggage and process data corresponding to absorption of X-rays to 
reconstruct a cross-sectional view of the contents of the baggage. Conventional 
systems include a processing device which may optionally digitally manipulate the 
S image generated by the detector arrangement, and a display system which presents the 
image for inspection by an operator, who then decides whetiier contraband is located in 
the baggage based on the shape and location of the iim^ed items. Generally, in 
conventional systems, analysis of the image by tibe operator is done at the same 
physical location as where the inspection system is located. 

10 UN/EDFACT (United Nations Rules for Electronic Data Interchange for 

Administration, Commerce and Transport) is a set of internationally agreed to 
standards, directories and guidelines for the electronic exchange of structured data and, 
in particular, electronic exchanges related to trade in goods and services between 
independent computerized mformation systems. The UN/EDIFACT system is the 

15 standard for communications in the air transport industry, and is the language by which 
airlines and airports communicate their reservations, scheduling, and passenger and 
baggage information. A system known as Advance Passenger Information (API) is a 
system that utilizes UN/EDIFACT data to transmit and process passenger manifests. 
Passengers whose data matches a '^threat profile" may be separated for second-tier 

20 customs screening at destination airports. In the API system, passenger identification 
may be sent to customs authorities at a destination airport while aircraft is in flight 
The passenger identification data can be compared to computer databases containing 
profiles before the passengers arrive. Althougji this system expedites the customs 
procedure by second-tier screening only passengers who match the high risk profile 

25 model, the system relies on profiling individuals, and therefore suffers firom several 
drawbacks. For example, much of security profiling is based on the racial or ethnic 
origin of the passenger, leading to claims of racial discrimination and unlawfid search 
and seizure. Another problem with flie system is that it does not screen all passengers, 
but only those that match the hi^ risk profile model, resulting in an at least partially 

30 ineffective system which may miss some baggage that includes illegal contraband. 

SUMMARY OF THE INVENTION 
According to one embodiment, a system for baggage screening that is remotely 
monitored and controlled comprises a plurality of baggage inspection machines that 
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obtain infonnation about an item under inspection, each baggage inspection machine 
being coupled to a local network link, a storage medium, coupled to the local network 
link, that stores the information obtained by &e plurality of bajggage inspection 
machines and a controller, coupled to the local netwoik link, the controller being 
S configured to retrieve the information about the item under inspection from the storage 
medium via the network link and to process tibe infonnation to provide processed 
infonnation. The system iutttier comprises an operator interface conlQgured to recdve 
the processed information fi-om the controller and to provide Uxo processed information 
for inspection by an operator, wherem the operator interface is located remote from the 

10 plurality of baggage inspection machines and is coiq)led to the controller via a second 
netwoik link, which may be, for example, the latemet. The item under inspection 
includes a unique item ID, the unique item ID being associated with the information to 
link the information to the item under inspection. 

According to another embodiment, a baggage screening system for remote 

15 screemng of items under inspection may comprise a plurality of item files, each item 
file including a unique identifier that links the item file to an item xmder inspection and 
a database that stores the plurality of item files. The system may also include an item 
file mspection device that receives at least one item file of the plurality of item files, 
analyzes the at least one item file and records screening infonnation based on an 

20 analysis of the at least one item file, the screening information being linked with the at 
least one item file using the unique identifier, a server, coupled to the database and to 
the item iospection device, that retrieves tiie item files and the screening infonnation 
linked with the item files responsive to an input, and an operator interface, coupled to 
the server, that provides the input to the server and receives the plurality of item files 

25 and associated infonnation fix)m the server. 

According to another embodiment, a system for remote inspection of items inay 
comprise at least one inspection machine constructed to examine an item under 
inspection to obtain information about the item under inspection, a database coi:q)led to 
the at least one inspection machine, the database being adapted to receive the 

30 infonnation about the item under inspection &om the at least one inspection machine 
and to store the infonnation in an item file, the item including a unique item identifier, 
and an item file inspection device that receives the item file, analyzes data contained in 
the item file and records screening information based on an analysis of the item file. 
The system may fiirther include server, coiq>led to the database and to the item file 
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inspection device, the server being adapted to control transfer of the item file fipm the 
database to the item file inspection device, and transfer of the screening information 
firom the item file inspection device to the database, wherein &e screening information 
is linked with the item file using the miique item identifier, and wherein the database is 
5 further ad^ted to store the screening information, and wherein the item file inspection 
device is located remote fix)m the at least one inspection machine. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The foregoing and other features and advantages of the present invention will be 
10 ^parent firom the following non-limiting discussion of various embodiments and 
aspects ttiereof wi& reference to the accompanying drawings, in which like reference 
numerals refer to like elements throughout the different figures. In the drawings, 
FIG. 1 is a schematic block diagram of an exemplary baggage inspection 
system; 

15 FIG. 2 is a schematic block diagram of an exemplary local network of 

inspection machines including a remote access bridge, according to the present 
iavGntion; 

FIG. 3 is an exemplary illustration of a display that may be visible on an 
operator interface forming part of the local network of FIG. 2; 
20 FIG. 4a is an exemplary illustration of statistical data that may be displayed on 

the operator interface of FIG. 2; 

FIG. 4b is an exemplary illustration of an X-ray image on an item under 
inspection that maybe displayed on flie operator interface of FIG. 2; 

FIG. 5 is an exemplary log-on screen that may be displayed on tiie op^tor 
25 interface of FIG. 2; 

FIG. 6 is a schematic block diagram of an exemplary remote access system 
according to the present invention; 

FIGs. 7A-7F are exemplary displays provided on the remote operator interface 
of the system of FIG. 6; 

30 FIG. Sis a represCTtationofVarious icons that may be displayed on the operator, 

interface of the system of FIG. 6; 

FIG. 9 is an exemplary display illustrating a number of reports that may be 
selected for view; 
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FIG. 10 is a schematic block diagram illustrating communication between 
elements of the system of FIG. 6; 

FIG. 11 is a flow diagram illustrating communication between various software 
processes of the system of FIG. 6; 
5 FIG. 12 is an exemplary fQe control panel that may be displayed on the operator 

interface of the system of FIG. 6; 

FIG 1 3 is an text highlighting control panel that may be displayed on the 
operator interface of the system of FIG 6; and 

FIG. 14 is a flow diagram of one exemplary embodiment of a system and 
10 method of remote baggage screening according to the inventioiL 

DETAILED DESCRIPTION 
The present mvention is directed toward a system and methods for screening 
items, for example, baggage or packages, particularly from a remote location. The 

15 system includes transmission of scamied information about items under inspection from 
a first location where the scanning occiws, to a second location that may be remote from 
the first location. Operators may access the information from the second location, or 
from yet another location, over, for example, a secure network or IntOTiet link. In one 
example, the system may include one or more inspection machines that inspect item 

20 and obtain information about the items, and a server, located remote from the 
inspection machines, that has access to the information and to the machines. The 
machines may be any type of now known or later developed inspection machines. The 
information may also mclude, or be linked to, information regarding passengers to 
whom the items belong, a point of origin of the items, or other information. 

25 , Referring to FIG. 1 , fliere is illustrated one exemplary embodiment of a ba^age 

inspection system according to the present invention. It is to be appreciated that 
although the following discussion will refer in particular to baggage inspection systems 
located at airports, the invention is not so limited, and may be equally applied to 
baggage screening at, for example, bus depots or train terminals, or to screening of 

30 packages at, for example, post offices or other mail centers. According to one example, 
items of baggage 100 may be tranqwrted along a conveyor 102 and maybe examined 
by one or more baggage inspection machmes 104, 106. According to the illustrated 
embodiment, the system includes two levels of screening: a level one inspection 
machine 104 and a level two inspection machine 106. Items of baggage 100 that are 
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not cleared by the level one inspection machine 104 may be transported to the level two 
inspection machine 106 for further examination. It is to be appreciated that the system 
is not limited to two levels of screening, as shown, but may include only one level of 
screening, or more than two levels of screening, as desired. 
5 According to one embodiment, an item under inspection 108 may be examined 

by an inspection machine 104 to determine information about the item under inspection 
108, such as, for example, whetiier the item under inspection 108 potentially contains 
contraband or hazardous substances. If a region of interest is detected within the item 
under inspection 108, the item may be sent for further examination by an inspection 

10 machine 106. The inspection machine 106 may perfoim a more detailed examination 
of the item under inspection 108, and in one sample, may focus its examination on the 
region of interest identified by inspection machine 104. According to one example, the 
inspection machines 1 04, 1 06 may be X-ray inspection machines that may obtain an X- 
ray image of the item under mspection 108 by detecting X-ray radiation eittier 

15 transmitted through or scattered firom the item under inspection 108. It is to be 

appreciated that alttiough throughout the following discussion, the inspection machines 
104, 106 will be referred to as X-ray inspection machines, the mvention is not so 
limited, and these machines may be any type of baggage inspection machines 
including, for example, vapor detection machines, magnetic resonance imaging (MSI) 

20 scanners, CT scanners, or another type of inspection machiae. 

As illustrated in FIG. 1, the inspection machines 104, 106 may be coupled to 
operator stations 1 10, 1 12, respectively. The operator staitions 110, 1 12 may include a 
processing device that may digitally process the data received jfrom the inspection 
machines 104, 106, and may also include a display to present the information, for 

25 example an X-ray image of the item under inspection 108, to an operator. The operator 
may then examine the image and make a decision as to whether or not to clear the item 
under inspection 108. It is to be ^reciated that alfliough the illustrated embodiment 
includes two operator stations, one coupled to each inspection machine 104, 106 
respectively, the system is not so linodted, and, for example, may include a single 

30 operator station coupled to both inspection machines. It is further to be s^predated that 
while operator station 110 will be discussed in more detail below, the discussion will 
apply equally and interchangeably to operator station 1 12. 

The inflection machines 104, 106 may further be coupled to a server 114. The 
server may include a storage unit that stores infonnation, such as the X-ray images of 
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items under inspection 108, in a database for access by, for example, an operator station 
112. The server 114 may also include a processing device that may digitally process 
the data received from the inspection machines 104, 106. The server 1 14 and its 
operation will be discussed in more detail below. 
S According to one embodiment, a local network of baggage screening machines 

including, for example, inspection machines 104, 106, may be provided at a certain 
location, for example, an airport. The local network of inspection machines may 
include a plurality of machines located at various tenninals throughout the airport. The 
plurality of inspection machines may be coupled to a remote access server, such as 

1 0 server 114, thereby forming the local network. A remote operator station may be 
coupled to the local netwoik of inspection machines via the remote access server. 
Neither the remote operator station nor the remote access server need be located at tihe 
same location (e.g. the same airport) as the local netwo± of machines, because the 
remote access server, the remote operator station and the local network of machines 

1 5 may be coupled to one another using a secure Internet or other long-distance network 
connection and protocol, as will be discussed in more detail below. 

According to one embodiment, the remote access server may include a remote 
access bridge which may operate on a computing machine connected to the local 
network of baggage inspection machines. Through the remote access bridge, an 

20 authorized operator located on the premises of the local netwoik of baggage screening 
machines may view and change the status of any machine connected to the network. 
The operator may also view statistical data related to all the inspection machines 
connected in the local network. Referring to FIG. 2, there is illustrated an exemplary 
local network 200 including a plurality of inspection machines 202, a remote access 

25 bridge 204 coupled to the plurality of inspection machines 202, and an operator 
interface 206 coiq)led to the remote access bridge 204. Through the remote access 
bridge 204, an operator using the operator interface 206 may view information relating 
to each of the individual inspection machines 202, and to the entne netwoik 200. The 
remote access bridge may further include a database 208 that stores the information. In 

30 one example, the local network of inspection machines, the database and the remote 
access bridge may all be connected on a common subnet, which is a portion of a 
network that shares a common address component For example, on TCP/IP networks, 
such as the Internet, subnets are defined as all devices whose IP addresses have the 
same prefix. For example, all devices with IP address that begin with 100.100. 100 
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would be part of the same subnet. Thus, an operator connected on the same subnet as 
the remote access bridge and the local network of inspection machines may have access 
to the machines and data on the subnet, as discussed above. According to another 
example, an operator on a different subnet may access, via the remote access bridge, 
S statistical data relating to the inspection machines connected on the local network. 

According to one example, the remote access bridge 204 may be based upon a 
multi-threaded application, with one thread handling all operator interface issues, and 
the other thread managing the connection to the network of baggage screening 
machines. Both threads may use various synchronization methods to read iGrom and 

10 write to and from a common database. The database may be a central soxirce of 

information regarding status of the local network and the individual baggage screening 
machines 202, and information received by the baggage scre^iing machines about item 
under inspection (108, FIG. 1), Each baggage screening machine 202 connected to the 
local networic may include a unique IP address, or other identifier, that allows the 

15 remote access bridge 204 to know what type of machine it is, and what the status of the 
machine is, i.e., active, inactive, or in a fault condition. In one example, the operator 
interface 206, coimected on the first subnet with the inspection machines, may include 
a display including icons representing each of the baggage screening machines 202 
included in the local network. The information shown in the display on the operator 

20 interface 206 may be controlled and updated by software running on the remote access 
bridge 206, and also by instructions firom an operator using the operator interface 206, 

FIG. 3 illustrates one example of a display 208 on the operator interface 206. 
The display includes machine icons 210 representing each of the baggage inspection 
machmes 202 (FIG. 2) in the local network. The inspection machines may include 

25 woricstations 210a or mainfi^es 210b. In one example, the remote access bridge may 
change the appearance of the icons on tiie display 208 depending on a condition of the 
machine represented by the machine icon 210. For example, machines that are in an 
active condition may be represented by icons having a certain appearance, for example, 
a particular color, while machines that are in an off-line condition may be rqjresented 

30 by, for example, gray icons. Machines that are in a fault condition may be represented 
by icons that are, for example, red or blinking. The remote access bridge may 
continually update the display so that the machine icons represent a current status of 
each inspection machine coimected in the network. In some examples, an airport or 
otho* terminal may employ multi-level baggage screening, as illustrated in FIG. 1 . In 
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these examples, the remote access bridge may update the display 208 to indicate to 
which level each particular machine belongs, and may group the icons representing the 
machines according to levels of screening. For example, a machine icon may include a 
number 212 indicating that the machine represented by that machine icon is, for 
5 example, a level 2 inspection machine. 

According to another example, each machine icon may include a decision 
indicator 214. The remote access bridge may alter ttie appearance decision indicator 
based on infotmation received, either fix>m the inspection machine associated with Ifaat 
icon or from the operator, regarding a clearing decision made about an item under 

10 inspection. For example, if one of fhe inspection machines in the netwoik examines an 
item under inspection and a decision is made to clear the item, the decision indicator 
214 may, for example, blink green. Alternatively, the decision indicator 214 may blink 
red for a reject decision, or may display, for example, magenta if the decision does not 
occur within a predetermined amount of time. The display 208 may ftirther include 

1 5 menus or radio buttons 2 16 to enable an operator to access additional data. For 

example, the remote access bridge may store statistical data, regarding, for example, the 
percentage of items under inspection lhat are cleared as opposed to rejected within a 
certain time period, e.g., a day, month or year. The remote access bridge may also 
archive X-ray images of all items of baggage that are inspected by the machines 

20 connected to the local network, which the operator may access using the buttons 216. 
The menus or buttons 216 may also enable the operator to access report files generated 
by the remote access bridge, error logs, and system configuration ioformation, as will 
be discussed in more detail below. It is to be appreciated that the remote access bridge 
and/or operator interface may be provided with another means for accessing the report 

25 files, error logs and system configuration information, other that the menus or buttons 
216. 

Referring to FIG. 4a, there is illustrated one example of statistical data that may 
be displayed by the operator interface. As illustrated, fhe display 208 may provide for 
the operator to select a date for which the information is displayed, and may also select 
30 whether the data is from the entire network, or for example, fix)m the level two 

inspection machines, or from a particular individual machine. FIG. 4b illustrates an X- 
ray image of an item under inspection bemg displayed on the display 208, As 
illustrated, an operator may select the image corresponding to a particular item under 
inspection based on a item identifier 220, or by day and time using select buttons 222. 
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using buttons 224, the operator may also select to display images from a particular 
level of inspection. 

Referring again to FIG. 3, in one example, an authorized operator may be able 
to program the remote access bridge to store data from each machine in the netwodc for 
S a predetermined amount oftime, indicated by buttons 218. These predetermined 
amounts of time may be different depending on, for example, the level to which the 
inspection machine belongs. The remote access bridge may require an operator to 
securely log on to the operator station to access the system. An exemplary log-on 
screen that may be displayed on the op^or interface is illustrated in FIG. 5. The 

10 operator may be required to enter an operator ID 230 and a password 232, in order to 
gain access to the information stored by the remote access bridge, and also to alter the 
configuration of the inspection machine connected in the network. Different levels of 
access may be provided to different operators. For example, there may be an 
administrator class of operators and a user class of operators, similar to those 

1 5 commonly used on many local area networks. As mentioned above, the remote access 
bridge may also generate reports regarding screening decisions, online and offline 
activity of various machines in the network, and faults that occur at different machines 
and the time at which a fault occurs. These reports may be generated according to a 
selected time period, for example, by the hour, daily, weekly or monthly. 

20 Thus, the remote access bridge allows an authorized operator, access to the 

information and data collected by the baggage inspection machines, and configuration 
of baggage inspection machines within the local network connected to the remote 
access bridge. This allows a single operator at an operator station to monitor and 
control a plurality of baggage inspection machines fluroughout a particular airport, or 

25 other screening location. 

According to another embodiment, one or more local networks of baggage 
screening machines may be coupled to a remote access server which gives a r^ote 
operatpr the abiUty to manipulate and access information on a virtual network of 
machines, as if the operator were using the remote access bridge described above. The 

30 remote access server, however, allows the operator to be located on a different premises 
to the network of baggage screening machines. In other words, via the remote access 
server, an operator not connected on the same subnet or local network as are the 
inspection machines may access and manipulate information gathered by the local 
network of machmes. The operator may access the local network via, for example, the 
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Internet. The remote access server thereby enables remote baggage screening by an 
operator located anywhere in the world. In addition, the remote access server allows 
the operator to view X-ray images collected by the inspection machines, to perform 
remote screening of itennis examined by the machines, as will be discussed in more 
5 detail below. 

The remote access server differs from the remote access bridge discussed above 
in at least two aspects. The remote access bridge allows an operator connected on the 
same subnet as the local networic of inspection machines, access to the machines' 
configuration settings and statistical information collected by the machines. The 

10 remote access server allows an operator connected on the same local netwodc, full 
access to not only statistical mformation and configuration settings, but also to X-ray 
and other images and data collected by the local network of inspection machines. The 
remote access server also enables an operator not connected on the local network, but 
remotely located, fiill access to the local network of machines, and information, 

1 5 including, for example, images of items under inspection, etc.. Thus, via the remote 

access server, a remote operator possibly located in a different city, or even a different 

■J 

country fi-om the local network of inspection machines, may access all inforaiation, 
and data firom the local network. It is to be appreciated that an operator accessing the 
remote access server may be connected on the same subnet or local network as are the 

20 inspection machmes, but may also access the local network via, for example, the 
Internet, or another long-distance access means. 

An exemplary system according to this embodiment is illustrated in FIG. 6. 
The system includes a remote access servo: 300 and one or more local networics of 
inspection machines 302, 306 coupled to the remote access sorver 300. Each local 

25 network 302, 306 may include a plurality of inspection machines 304, including both 
workstation and mainframes. It is to be appreciated that a local network of baggage 
screening machines 306 may be coupled to a remote access bridge 308, as described 
above, which may serve as a central controlling computer for the local network 306, but 
that this is not required. The remote access server may be also coupled to a storage 

30 element 310 and a remote operator station 312. The remote access server 300 allows an 
operator using the operator station 312 to independently access each baggage screening 
machine 304 in each of a plurality of local networks of machines, and information 
collected by the machine, without the need for a central controlling computer at each 
local network. Through the remote access server 300, an operator may observe the 
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system operation, change configuration settings on any machine 304 coiinected to the 
network, and interact with various parts of the networks The remote access server 
system allows end users, such as arrival side (for example destination airports) baggage 
inspectors to retrieve mfonnation about baggage that was acquired by departure -side 
5 (for example, point of origin airports) screening machines. The remote access server 
300 allows a remote operator to interact with a local baggage screening network from 
any operator int^ace 312 connected to the local netwoik via, for example, a secure 
Intemet coimection. 

According to one embodiment a local network of inspection machines 302 may 

10 be located at a first airport. An item of baggage, hereinafter referred to as an item 
under inspection, may be examined by an inspection machine 302 which may obtain 
information about the item under inspection, for example, an X-ray image of at least a 
portion of the item under mspection. The item under inspection may be provided with 
a unique item identifier that may be used to link the information obtained by the 

1 5 inspection machine with the item under mspection. The information, for example, the 
X-ray image may be stored in the storage element 310 which may be located at the first 
airport or at another location. Operators at the remote operator station 312, which may 
be located at, for example, a second airport, may access the stored information/images 
fi^om the storage element via the remote access server 300. For example, an item under 

20 inspection may be imaged by an inspection machine at a departure airport of a 

passenger. While the passenger is in flight, the X-ray data for, and other information 
regarding, the item under inspection may be retrieved through the remote access server 
by an arrival-side authorized operator. The arrival-side operator may view the unage of. 
the item imder inspection alone, or may use the results of a departure-side automated 

25 detection algorithm, or may apply another detection algorithm to the stored X-ray data 
retrieved via the r^ote access server. 

The X-ray data and/or other information obtained about the item under 
inspection may be combined with passenger manifest information, and/or other flight or 
aixport information such that detection algorithms may be tailored to a specific 

30 passenger's point of origin or other passenger information; The unique item identifier, 
which may be, for example, a barcode or radio fi-equency (RF) transponder encoded 
with a unique code and attached to the item under inspection, may be used to link the 
X-ray images of the item with passenger and/or fligjit infoimation stored in a database. 
Such information may include a digital photogr^h of the passenger, possibly carrying 
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the item, and/or other information, for example, the passrager's passport number. In 
one example, an operator may be able to access X-ray images and information for 
baggage associated with a particular flight, or may be able to access images and/or 
information relating to an individual item of baggage using the unique item identifier. 
5 Checked baggage may be examined sq>arately from hand-carry baggage which may 
also be inspected using automated or conventional methods. Once the passenger and 
baggage information is stored in tiie database linked to the remote access server, an 
operator may access that information from any location world-wide. It does not matter 
whether the information is automatically stored in the database during inspection of the 

10 items of baggage at their point of origin, or whether flie information is manually 
entered by other opo^tors. 

According to another exanq>le, the remote access server 300 may update the 
display at the remote operator interface 312 in response to requests &om the remote 
operator interface 312» For example, the operator interface may display icons 

15 representing a plurality of inspection machines coimected in the network, as illustrated 
in FIG. 7A. Each icon on the display may include an indicator 340 that tells the 
operator to which local network the inspection machine belongs, or at which airport the 
inspection machine is located. As discussed in relation to the remote access bridge, the 
remote access server may alter the appearance of any icon on the display to reflect a 

20 condition of the machine represented by the icon. For example, in FIG. 7A, an icon 
342 is shown in a fault condition, and an icon 344 is shown in an offline condition. By 
accessing the display, for example, by clicking on the network icon 346 or on a 
machine icon 348, an op^ator may access various menus 350, as illustrated in FIGs. 
7B - 7F, allovraig the operator access to system, network and machine information and 

25 statistics. By clicking on any icon, the operator may acc^s information and statistics 
regarding the machine or local network represented by that icon. FIG. 7C illustrates 
information obtained by selecting the network statistics option on the menu 350 of FIG. 
7B. FIGs. 7D and 7B illustrate statistical information displayed for two mainframes, 
and FIG. 7F illustrates information displayed for a workstation. 

30 According to another embodiment, the remote access server 300 may further 

alter the appearance of icons on the display to illustrate activity at the various 
inspection machines in the network. FIG. 8 illustrates a plurality of icons, representing 
mainframes and workstations, that may be displayed on the remote operator interface 
312. It is to be appreciated that FIG. 8 is not intended to show the ^pearance of an 
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actual display screen, but to illustrate examples of the appearance of various icons to 
provide information to the operator. For example, icon 360 represents an inspection 
machine that is not currently inspecting an item, whereas icon 362 represents an 
inspection machine that has recently examined an item. The icons may be continuously 
5 updated by the remote access server to reflect activity at each of the inspection 
machines in the network. It is to be appreciated that the icons may be changed to 
reflect the type of activity occurring at a particular machine^ without necessarily 
providing an exact indication of the arrival and disposition of items under inspection. 
The remote access server may provide a snnulated activity at a rate that mimics the 

10 currmt rate of activity at the machine represented by the icon. 

In another embodiment, at least some of the wodcstation icons 364 may be 
provided with a queue indicator 366 that may indicate a size of the item under 
inspection queue at tiie corresponding workstation. As shown, the queue indicator 366 
of icon 364 is empty, indicating that the queue for the workstation represented by icon 

15 364 is currently empty. As the workstation's queue fills up, the queue indicator at the 
corresponding icon likewise fills wp, as shown at icon 368. In one example, the color 
of the queue indicator may change, for example, form green to red, as the queue fills 
up. Icon 70 represents a workstation with a full queue. It is to be appreciated that the 
queue indicator is intended as a visual indicator of the state of the queue of the 

20 corresponding workstation, and is not necessarily intended to be an exact indicator of 
the number of items awaiting inspection at the workstation. It is further to be 
appreciated that the icons representing mainfi:ames may also be provided with queue 
indicators. A workstation icon 372 may finther be updated to illustrate that an item is 
currently being inspected by the workstation, or that a suspicious region has been 

25 detected in an item under inspection, by showing an image 374 of the item on the 
workstation icon. 

As discussed above in relation to the remote access bridge, the remote access 
server may be adapted to generate reports regarding, for example, the number of itrais 
inspected, the number of faults occurring at various machines, etc. An operator may 
30 request such a report my clicking on an icon on the display. FIG. 9 illustrates an 

example of a di^lay where an operator may select one of a plurality of reports to view. 

Referring again to FIG. 6, in one embodiment. X-ray images of passenger bags 
for arriving flights for an entire airport may be collected by the remote access server 
300 &om local networks 302, 306 of inspection machines 304 located at the point of 
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origin aiiports of the airiving flights. The images and infonnation may be stored in a 
central database, for example, storage element 310, and may be inspected by a 
centralized team of operators, or by an automatic detection algorithm, at operator 
station 312. The remote access server 300 provides all the features and utility discussed 
5 above in relation to the remote access bridge, and additional features and utility, to a 
remotely-located operator. When a unique item identifier, conresponding to arriving 
passengers baggage, is entered into the system, the results of the inspection of fliat item 
may be presented to an arrival-side screening agent. These results may include the X- 
ray image of the item and other infomiation, or may be a simple as a decision indicator, 

1 0 for example, a green light for "all clear*' or a red light for "inspect further." Several 
different arrival*side authorities may have access to the same passenger bag images via 
the remote access server 300. For exanq>le, if a US customs inspector has cleared a 
bag, but a US Department of Agriculture (USD A) inspector wishes to further examine 
the bag, the customs inspector may see an indication that the passenger must go 

1 5 through USDA. before being cleared, when the item identifier is entered into the 

system. This system has a number of advantages, including that airlines may retrieve 
bag images to investigate insurance claims for lost items, the weight, size and other 
physical characteristics of passenger baggage may be stored and analyzed for airline 
and aiiport planning, and governmental authorities may inspect the bag images in the 

20 event of a terrorist attack on a flight Each unique item identifier may be linked to an 
inspection machine serial number, and/or a time and date when the image was created, 
allowing for detailed tracking of items of baggage. Results of an automatic detection 
. algorithm may also include specific details such as the serial number of the inspection 
machine, geometry, and operating and service history for that machine. 

25 According to one example, image search tools may be employed to select 

images firom a large database of real images for training purposes. These images may 
be used to established algorithm training sets fiom a large number of bags, perhaps 
randomly selected over the course of many days, months or years. These training sets 
may be used to train operators, or automated detection algorithms. The system 

30 provides owners, and operators of X-ray inspection equipment witti information as to 
the current status of baggage information, operator workload, decision time, percentage 
of bags rejected, etc. for a group of connected inspection machines. This infonnation 
may be useful for system maintenance and planning. It is to be appreciated that 
altiiough the above discussion focused on passage baggage screening for airlines, the 
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system may be used in a number of other ^plications. For example, the system may be 
used to screen cargo instead of passenger bags, or may be used for non-destructive 
testing during manufacturing processes. 

As discussed above, the remote access server provides an interface to a 
5 connected groiq) (network) of baggage scre^aing equipment. According to one 
embodiment, the remote access server operation may be based on Int^et server 
software which may enable access of the server through the **web page" pamdigm. 
This paradigm provides benefits 'm tiie form of familiar gn^hical user interface an 
established and available software and methodologies. The remote access server 

1 0 software may provide a web-based interftice that may be remotely accessible by 

operators through a conmiercially available browser which may be operating either on 
the remote access server itself or on a remote computer. Remote computers may be 
located at any site worldwide, and commercially available security and encryption 
methods may be used to protect s^isitive data. Some examples of such security 

15 methods include, but are not limited to, secure socket layer (SSL) protocol and virtual 
private network (VPN) protocol. It is to be appreciated that the temi "computer" as 
used herein refers to a computing machine in the generic sense, and applies to any type 
of portable, personal or mainframe computing device including one or more processors. 
It is fiiriher to be appreciated that the temi "computer program" is used herein in a 

20 generic sense to refer to any type of computer code (e.g., software or microcode) that 
can be employed to program one or more processors so as to implement aspects of the 
present invention. 

According to one embodiment of the invention, the remote access server 
includes a collection of co-operating processes and services that have access to a 

25 network of inspection machines and is able to serve web pages. Users of the remote 
access server may access the web pages through commercially available browsers (a 
commercially available internet interface program, such as Internet Explorer, or 
Netscape Navigator) running eifiier on the remote access serv^ itself or on a remote 
computer located at any site world wide. Commercially available security and 

30 encryption methods can be used to protect sensitive data. The browser may operate on 
the same computing machine as the remote access s^er or on a different one. The 
remote access server software may provide delivery of web pages, delivery of real time 
information, and maintenance of data on a browser, through a number of different 
protocols while maintaining the same graphical user interface. Images of items under 
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inspection, gathered by tbe network of baggage screening equipment, may be stored on 
some storage medium for access by operators through the remote access server 
interface. The storage medium may include a database, including a commercially 
available program, for example, Oracle, that has a structured query language interface 
5 available via open database connectivity. The database may be located on the same 
computing machine as the remote access server, or may be separate from the server The 
remote access servo: may offer remote viewing of inspection data, for example, images 
of the items under inspection, other data, such as the locations serviced by the system, 
and remote report generation.. 

1 0 Referring to FIG. 10, there is illustrated an exemplary embodiment of a system 

including a remote access server 400 coupled to one or more local networks 402 of 
inspection machines 404, and a remote operator interface 406 that includes a graphical 
user interface 408. The remote access server 400 may include a plurality of processes 
410 that may run in different threads to control aspects of the systems, such as 

1 5 interfacing with the local network of inspection machines and with the operator 
interface. Although not illustrated, the local network 402 may include a central 
controlling computer, such as a remote access bridge (326 FIG. 6). However, as 
discussed, it is to be appreciated that provision of the remote access bridge is optional, 
and not necessary. In the illustrated embodiment, database 412, which may store 

20 information and images obtained about items under inspection that were examined by 
the local network 402 of inspection machines, is shown located at the same location as 
local network 402. However, it is to be ^predated that database 412 may equally be 
located on the same computing machine as the remote access server 400, or may be 
located at another, remote location. Furthomore, the system may be provided with a 

25 plurality of storage elements in addition to database 412 that may store system 
information. 

According to one embodiment, the remote access server 400 may provide a 
secure log on methodology to prevent unauthorized access to the system. In one 
example, a log-on screen that may be presmted on the display of the operator interface 
30 406 may be that illustrated in FIG. 5. In one example, the remote access server may 
provide a secure method for logged on administrators to manipulate a database of 
operators who may log on to the system. The remote access server may also allow 
authorized operators to run diagnostic tests on the mspection machines connected to the 
network, and to receive the results of such tests, whether initiated remotely or locally. 
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The remote access server may further allow authorized operators to examine error logs 
and other files maintained at the individual inspection machines of the network. 

Once authorized operators have logged on, the remote access server may 
provide a secure method for the authorized operators to control individual inspection 
• 5 machines in the network, and local networks as a whole. As discussed above, access to 
the system may be provided through a web page based display (gr£qphical user interface 
408) on the remote operator interface 406. Web pages may be delivered either by 
hypertext transfer protocol (HTTP), secure hypertext transfer protocol (HTTPS), or 
another secure methodology. The graphical user interface 408 presented on flie diq)lay 

10 may be fee same regardless of which protocol is used to deliver the web pages, but the 
security of the transmission may vary. When the browser and the remote access server 
operate on the same computer, the need for security is minimized and a less secure 
protocol may be used for data transfer between the server and the browser. When the 
remote access server is located on a remote computer, a more secure protocol may be 

1 5 required to ensure integrity of the data and to prevent improper access. 

The operation of the browser and the remote access server may be designed 
around an Internet home page that is loaded infrequently and satelUte pages which may 
be opened in other windows on the display as required. DeUvery of these pages may 
use the common gateway interface (CGI) which is part of conventional HTTP and 

20 HTTPS specifications. Common gateway interface programs that deliver reports to the 
operator interface 406 may use open database connectivity (ODBC), a standard 
database interface, to access the database 412. The database 412 may employ any 
commercially available program, and may store the X-ray images and other passenger 
and system operation information. When the browser and the remote access server are 

25 operating on the same computing machine, tiiere may be no need for a secure 

transmission protocol. However, when the browser is operating on a remote operator 
interface 406, it may be desirable to prdvide a secure transmission protocol to prevent 
unauthorized interception of the data 

According to yet another embodiment, the remote access server may be ad^ted 

30 to deUver real-time information to a web page displayed on the browser on the remote 
operator interface 406 without reloading that page. One exemplary methodology that 
may be utilized to perform this task is on a Simple Object Access Protocol (SOAP), 
although the remote access server is not limited in this regard and any suitable protocol 
may be used. SOAP allows the delivery of information using the HTTP protocol 
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without disrupting the web page that is on view on the browser. According to one - 
exemplary method of using SOAP for deUvery of real-time information, the remote . 
access server 400 may collect real-time information firom various inspection machines 
404 and equipment in the netwoik, and may save fh& information in the database 412 
5 using the open database connectivity interface. The remote access server 400 may 
make the information stored in the database 412 available via pipelines, shared 
memory, or another real-time interfece to a SOAP server. One or more of the CGI 
programs (servCT processes 410) running on the remote access server may act as a 
SOAP server. This program may be written in various languages including, for 

10 example, Perl or Java. Conventional open source SOAP implementations are available 
for these two languages. A SOAP receiver operating within the browser on the remote 
operating interface 406 may also be implemented using Java and available Open Source 
SOAP implementation for Java. To allow the SOAP operations to be asynchronous 
fiiom the web page operations, this receiver may use a separate thread. Using the CGI 

1 5 programs and SOAP, the remote access server may s&nd directions to a remote access 
bridge located at the local network 402, as if an operator were present at the remote 
access bridge console. The remote access server may process the remote access bridge 
responsive and make them available to the remote access server. Thus, the remote 
access server uses SOAP to make the functionality of the remote access bridge 

20 available to the remote operator interface. However, the functionality of the remote 
access server programs is not limited to SOAP, and may use any other known or future 
developed protocol. 

According to another embodiment, the remote access server may use the 
document object model standard, which is a developing world wide web standard for 

25 dynamic modification of web page contents on a browser, to update the infonnation 
displayed on the web pages of the browser operating on the rraiote operator interface. 
The programming language for the document object model programs may be 
JavaScript, Visual Basic, or anotiier language, as desured. Document object model 
programs encoded using one of tiiese languages may communicate with the SOAP 

30 receiver, for example, using Java programs, and may modify almost any aspect of a 
web page after it is loaded, without disrupting the page. Document object model 
programs operating within the various web pages may drive visual changes in concert 
with real-time SOAP transmissions, thereby updating the infonnation displayed for the 
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Operator in real-time. They may also keep limited copies of the database information 
operating on the server and may present it to an operator on demand. 

Referring to FIG. 1 1, there is illustrated an example of information flow 
between the remote access server 400, a local netwoik 402 of inspection machines, and 
5 a client browser 406. A serving engine, such as Apache, may provide the HTTP, 

HTTPS or other network protocol through which interactions with flie client's browser 
occur, and und^ which the connnon gateway interface processes run. Referring again 
to FIG. 10, the remote access server contains software and/or hardware to run server 
processes 410, and transmits infonnation to and receives information fiom the local 

10 netwoik 402 and tiie client browser 406 by sending and receiving messages 414. The 
operator interface 406 may include one or more processors that may run a plurality of 
processes to display information received from the remote access server 400, and to 
relay information to the remote access server 400. 

According to one embodiment, at the start of a client session, the remote access 

15 server 400 may produce a 'T>lank canvas" for the session and send it to the operator 
interface 406. This blank canvas may contain all the object definitions and function 
programs, coded using Java and JavaScript for example, that may be needed during the 
client session. As soon as the blank canvas page has been sent to the operator interface 
(the client), the Java and JavaScript functions may begin their initialization process and 

20 the graphical display 408 of the operator interface may be populated with icons 

representing of all objects on the remote access server 400, as discussed above. The 
Java and JavaScript services are illustrated as processes 416 on the operator int^ace 
406 in FIG. 10. The Java and JavaScript services, wait for and handle infomiation and 
control the state of objectis on the client side. They may act to transmit infonnation 

25 from the remote access server 400 to the client, and to transmit information from the 
client to the remote access server. They may act to request data from the remote access 
server, or notify the remote access server 400 of a change in status of a process. They 
may also receive and handle messages fix>m the server and convert them to an updated 
display, for example, through the Document Object Model. The transmissionis between 

30 the server and the client browse may be made using SOAP. Once the browser receives 
information from the server (via Java in a sqparate thread), it may make that 
infonnation accessible to the JavaScript services that control the objects in the 
Document Object Model. The Java programs may operate in a separate software thread 
so that they are asynchronous to other operations on the browser. 
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Services on the client browser may operate to send information to and receive 
information Sx>m the graphical display. One or more of these services may be 
responsible for displaying HTML pages on the grq>hical display illustrating, for 
example, a graphical representation of bag rate versiis time, and images of scanned 
5 bags. One or more of the services may be responsible for converting X-ray image files 
received from the remote access server in a proprietary format to a standard format for 
viewing in a browser, for example, JPEG, PNG, or some otiier format This conversion 
may be implemented using, for example, a C-H- program, or other suitable software. In 
order to speed up transf^ of images from the network via the remote access server to 

10 the cUent browser, the images may be transmitted via the network protocol in a 

compressed (e.g. zip) format. In such cases, the climt browse may include software to 
decompress (e.g. unzip) the images. 

According to another embodiment, software may be provided to allow an 
operator to select a section of a file (e.g. a report file or statistics file) that they wish to 

1 5 view rather than the whole file. This may allow a more effective use of the network 
bandwidth between the server and the client. To allow viewing of a desired section of a 
file, regardless of where it is within the file, the software may be encoded to use the 
Fibonacci sequence of numbers to divide the file, rather than binary numbers as are 
conventionally used. Division by Fibonacci numbers may be superior to division by 

20 binary nxunbers because successive section sizes in a Fibonacci scheme differ by a 
factor of 1 .62 rather than a factor of 2 as in a binary scheme. Therefore, using a 
Fibonacci scheme provides more choices of file section sizes than does a binary 
sch^e. Furthermore, the place at which a file is divided is not the same for two 
adjacent sizes, and it is fhus more oft^ possible to locate a section of &e file that 

25 covers the area of interest because adjacent Fibonacci numbers always break the file at 
a different place. For example, usmg binary division, if the area of interest straddles 
the middle of the file, only viewing the entire file would show the whole area of 
interest, whereas with Fibonacci division, all sizes except 2 and 8 (corresponding to 
binary options) may produce a suitable section. FIG. 12 illustrates an exemplary file 

30 section control panel that may be displayed on the operator interface. The panel 480 on 
the left indicates files available for view and the size of each file. The control panel 
482 on the left may indicate the possible sections of the file that may be selected - i.e., 
the file divided into a plurality of sections. A particular section of a file may be 
selected by selecting the ^propriate file on the panel 480 and selecting the appropriate 



wo 02/082290 PCT/US02/10231 

-22- 

section on the control panel 482. Once the appropriate jSle and section is selected, 
clicking on the "view text*' button 484 may cause the file section to be displayed on the 
operator interface for viewing by the operator. 

According to another example, when a file, or section of a file, is displayed, an 
S additional text control panel, illustrated m FIG. 13, may be available to allow an 

operator to find and mark interesting elements (for exanq^le, a particular item identifier) 
in the file. If text is entered in the edit box 490, clicking the '^highlight texf ' button 492 
may cause all matching instances in the file to be highlighted according to the set of 
radio buttons 494. The checkboxes 496 on the left may allow for the case of the text to 

10 be significant or not, and for the use of '^regular expressions,*' which are those available 
in the programming language of the document object model programs. 

Also included in the remote access server software may be algorithms for 
analyzing images obtamed of items under inspection. Image analysis software (IAS), is 
software that may be used to automatically analyze X«ray image data using various 

1 5 algorithms for detection of target items or materials. The image analysis software may 
additionally process various images with a set of image processing algorithms that 
produce a better image for viewing by an operator. IAS may process stored image files 
of items, and may replicate the performance of an X-ray inaction machine screening 
real items. In one example, a single processor version of the image analysis software 

20 may be used to run a threat detection algorithm over a large set of stored bag image 
files and record the algorithm's decisions. IAS may be used to process large data sets 
quickly, and may produce a threat file for each bag image that is analyzed. This threat 
fiJle may contain a threat polygon similar to information that is seen on the operator 
interface of a baggage inspection machine. IAS may be used to analyze image files 

25 obtained firom a remote X-ray mspection system for contraband items such as currency, 
drugs or agricultural contraband. In another example, an X-fay image of an item under 
inspection may be stored in the database (412 FIG. 9), and may be associated with an ^ 
item identifier with the X-ray image that links the X-ray image to the item undra* 
inspection. The X-ray image may be retrieved Scorn the database by the remote access 

30 server in response to information provided about the item under inspection. The image 
analysis software may be used to analyze the X-ray image to locate a region of interest 
in the image, and may also perform fiulher processing of the image to obtain 
information regarding the region of intorest. Thus, IAS may be used to remotely screen 
items of baggage. 
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It is to be appreciated that the software implementing the above-described 
features may be provided on any type of computer-readable medium, and may be 
transmitted from one location to another via a carrier wave. 

The remote access server may allow operators to access one or more networks 
5 of installed baggage screening machines from multiple locations. Many operators, with 
different types of access to the system, can be logged on at any time. The remote 
access server allows information collected by the machines of an installed network to 
be separated a great distance from an operator interface where the information may be 
displayed; the distance being any distance then available by any communication 
medium such as the Internet. The remote access server isolates the proprietary network 
of installed miachines froni the public Internet through a secure connection allowing 
operators to access the network in a controlled and secure fashion. Data stractures may 
be used to mirror the state of tiie network of machines on the client browser, using, for 
example, JavaScript. 

According to yet another embodiment, the remote access server may be used to 
implement methods of advance baggage screening that may expedite customs screening 
procedures at airports. According to the advance baggage screening (ABS) model of 
the present invention, a passenger's bag may be imaged once at the passenger's point of 
origin. The bag may be immediately screened for departure threats, such as explosives 
or weapons, and may be associated with a unique item identifier. In one example, 
screening of the item under inspection may produce an image file that may be 
associated with the unique item identifier to link the image file with the item under 
inspection. The image file, together with the unique item identifier, maybe transmitted 
to an image processing center where software may be used to analyze ttie image file for 
contraband such as currency, drags or agricultural contraband. The results of the 
analysis may be transmitted to a waiting customs official at a destination airport Based 
on fliese results, the customs official at the destination airport may identify suspicious 
bags by the item identifier, and may send these bags to a second tier screening process. 
In one example, the system may use the passenger's point of origin for profiling, but is 
not dependent on other information regarding individual passengers. The advance 
baggage screening method disclosed herein may screen 100% of passengers, and not 
just those who match a high risk profile. The advance baggage screening model may 
require only one baggage inspection machine at the point of origin, by contrast with 
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prior art systems in which machines were required at the point of origin and at the 
destination airport, and possibly also at any intermediary airports. 

The ABS model of the present invention may include providing the information 
of threat detection without the encumbrance of selling a costly image machine. 
5 Although described here mostly in terms of an embodiment for aiiports, this system can 
be used for cargo as well as passengers^ and can be used for all transportation methods, 
such as trains, boats, road vehicles, and the like. 

The remote access server is one example of a means through which the ABS 
model can be implemented. The remote access server enables remote access to a 

10 network of inspection machines, allowing operators at any location to screen baggage 
at any other location. A business method according to the present invention 
contemplates a network of inspection systems that generate X-ray images of it^ns 
imder inspection. Each image may be associated with a corresponding item by a 
unique it^ identifier, which may include information regarding the item's point of 

1 5 origin and oflier information. The images and information may be stored on one or 
more central databases which may be accessed remotely by any number of authorized 
operators. Access to the images and information can be accomplished through the use 
of a web-based interface, as described above. The images may be processed using a 
number of threat detection algoritluns. 

20 One exemplary embodiment of a system and method of advance baggage 

screening at an airport, using the remote access server described herein, is discussed in 
detailbelow with reference to FIG. 14. It is to be appreciated that the system and 
method of advance screening may follow a diflferent procedure to that illustrated in 
FIG. 14, especially if the method is applied to cargo as opposed to passenger baggage. 

25 In a first step 500, a passoiger may purchases an airline ticket. Step 500 may be 

the point of entry for the passenger into the UN/EDIFACT system for passenger 
information. Although the illustrated outline of the system operation is based on the 
conventional UN/EDIFACT database, the system may use any type of passenger 
information database. 

30 In a second step 502, a UN/EDIFACT passenger identifier is assigned to the 

passenger. In addition, other information about the passenger may be entered into the 
database, such as, for example, the passenger's country of origin, the location where the 
ticket was purchased, whether the passenger paid for flie ticket with cash, etc. The 
passenger identifier may include a unique record identifier tihiat may be used to 
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reference all other pieces of information related to the passenger. The remote access 
server system of the invention may include all of the passenger information that the 
syst^ may be allowed to access according to government or airline regulations. For 
example, as well as X-ray or o&er data relating to the item under inspection, the system 
S may also access, for example, a digital photograph of the passenger or passeng^'s 

passport, and other information which may have been obtained at some point during the 
passenger's check-in procedure. Thus, a final display of an image of the passenger's 
bag for customs may include a text message including aU or part of the passenger 
information found among several related databases, UN/EDIFACT or others. 

1 0 Additionally, the algorithm lat^ used to screen the passenger's bag may be tailored to 
the information found in the passenger records. There are social and political pressures 
to reduce racial and ethnic profiling of passengers. The present system will make it 
possible to use other data to select the appropriate algorithm. The UN/EDDP ACT 
database 504 refers to the set of related databases that relate to passengers to their 

1 5 baggage and flight. The database 504 may be any database of passenger information 
that links the passenger to their baggage 

In a third step 506, the passenger checks in at the airport on the departure date 
At this point, the passenger is typically "confirmed" for the particular flight that he or 
she booked a ticket on. As a matter of security, bags will not be loaded onto a plane if 

20 the passenger has not confimied his or her reservation on that flight. This is followed 
by step 508 of confirming the UN/EDIFACT flligjit identifier for the passenger. When 
the passenger checks in with or without baggage, additional information may be added 
to the overall database of passenger/flight informatioiL Next, a step 510 of tagging 
checked baggage with a baggage identifier barcode may be performed. 

25 Conventionally, this ts^ contains a text message indicating the passengo^'s destmation 
and a barcode that contains ttie passenger identifier number. It is to be appreciated that 
although the step 510 is described herein as taggmg the baggage with a barcode, the 
system and method are not so limited For sample, the baggage may be tagged with 
an KF transponder encoded with a unique item identifier. The use of an RF transponder 

30 bag tag may significantly improve the performance of the system by improving the 
accuracy and speed of bag tag reading by electronic means. The bag tag may be 
manually or automatically entered into the database used by the remote access server 
system. 
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In a next step 5 12, the baggage barcode may be captured by barcode reader, and 
stored so that it may be related to the image that is produced by an inspection machine 
that examines the bag. In one example, a baicode reader is placed in relationship to the 
X-ray imaging device such that the X-ray system (or a system on the network of X-ray 
S systems) may bundle the image file with some identifying number that will relate the 
bag to the passenger. Again, it is to be appreciated that this step does not have to 
include a barcode read by a barcode reader, but could refer to an RF tag being read into 
the system or the manual entry of some bag identifier. 

In step 5 14 the passenger may board the plane. At this point, the passenger's 

10 boarding pass may be read electronically, and in step 516 the passenger's identifi^ may 
be added to an of&cial flight manifest. If a passenger who has checked in does not 
physically board the plane, his or her baggage will be removed fi-om the plan for 
security reasons. In one example, a passenger may be directly related to a specific 
flight in a database. However, the system may operate wherever the passenger can be 

1 5 related to their baggage - flight information may be helpful, but not necessarily 

required. Fligjit information naay provide a way to select the bag images and security 
information of interest to the arrival-side authorities at a particular destination. 
However, the system may operate with an identifier that links the bag to the passenger 
without flight information. The arrival-side authorities may use the passenger identifier 

20 to pull the bag image and other related information firom a very large database of all 
captured images. In one example, the bag image may be tied directly to the fligiht 
manifest Sending the bag unage with the flight manifest may be one way to 
communicate the bag image data. 

In stqp S 1 8 the baggage may be screened for departure-side threats and other 

25 ' targets. For example, the departure side airport may screm for explosives and 
contraband. At this step in the process departure-side information about the bag is 
produced. The departure-side information may include an X-ray image of the baggage, 
and the data for that image may be what will be sent for reprocessing for arrival-side 
authorities. The "imagmg** of the bag does not necessarily have to be an X-ray image 

30 that is reprocessed. The bag image may be a CT image that is simply re-displayed for 
human operators on the arrival side. A plurality of departure-side security screening 
techniques may be used as the source of bag data that is communicated from the 
departure-side to the arrival-side, whether reprocessed or not. 
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In steps 520 and 522 baggage for passengers on final manifest may be loaded on 
plane and the flight may depart. These steps are included to describe the physical 
location of the baggage at the end of the passenger departure process. 

At some point, the image of the bag has to be related to the passenger. This 
5 occurs at st^ 524 where the bag image file is bundled with the barcode. Bundling 
refers to adding the barcode to the bag image file. There are many ways that this could 
be done, through database links, the time the image is acquired, etc. What is important 
is that the bag image data and the bag or passenger identifier are linked in some way. 
This linkage is the means by which the bags will be properly identified by the arrival- 

10 side authorities, either directly or through a relational database (e.g., firom the flight 
manifest to die passenger identifier to the bag tag number). 

While the passenger is hi flight, the remote access server and image analysis 
software may be used by arrival-side authorities to remotely screen the images of the 
bags obtained by the departure-side aulhorities. For example, the remote access server, 

15 or an operator located at the remote operator interface may query a database to see if 
there is a customer for the information - step 526. At a minimum, this database may 
include a hst of destination airports. This database may also include information about 
what algorithms the customers may wish to use and other customizable settings. This 
step may include some means of communicating from the departure-side to the arrival- 

20 side that data of interest exists. In one example, a departure-side airport may be able to 
restrict access to airival-side authorities that it approves of. An airport authority might 
wish to allow some no access, some access to the bag data only, some access to the 
image only (e.g., a bit-map of the real X-ray data), and some access to both the 
bag/image and the threat information (the results of the departure-side algorithmic 

25 processing of the bag). Additionally, a digital signature system may be employed to 
verify that the image data and bag identifier are related and have not been tampered 
with since the bag system acquired the bag image data. 

Once it has been determined that an arrival-side airport requires (and is 
permitted access to) the data stored in the database, the image file and barcode may be 

30 transmitted to a processing location, as shown by step. The processing location may be 
an arrival-side airport or may be some other remote location. In one example, tiie bag 
image data and the identification linking it back to the passenger may be rq>rocessed 
for the arrival-side authorities. However, reprocessing is not required. An arrival-side 
authority might wish only to view the bag data/unage, or they may wish to see the bag 
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data and the results of the algorithmic processing of the bag from the departure-side 
algorithm. 

Step 530 includes selecting a detection algorithm with which to analyze the bag 
image. If the arrival-side authority wished to reprocess the bag image data, the 
S particular algorithm may be tailored for their specific needs. If the bag images go to an 
mtermediary location for reprocessing, some database linking the arrival-side auQiority 
to the appropriate algorithm(s) may be used to select the algorithm. A customer may 
choose to process each bag depending on the point of origin of the passenger. If so, the 
passenger identifier may be used to reference the passenger information (typically 

10 through the UN/EDIFACT system) to determine the passengCT*s point of origin. Other 
passenger information may also be used to select the algorithm used to reprocess the 
bag. The arrival-side authority could use any standard database query (e.g., a SQL 
expression) to detemiine which algorithm is used to reprocess a bag. 

hi step 532 image analysis software may be used to analyze bag images and 

15 creates a threat file for each bag. If reprocessing is chosen, some software may be used 
to re-analyze the bag, using the selected algorithm or another method of processing. 
The output of such processing may be a threatinformation file, containing the 
algorithm results, such as, for example, an outline of the threat found and other 
information about the threat. Further processing may be included to improve the 

20 appearance of the image for easier detection of contraband by arrival-side operators. In 
this case, the result of this processing may include a processed image, not a threat file. 

In a next stq) 534 the passenger may deplane at the destination. This step 
represents "arrival" in its many forms. In the particular example given, the passenger 
deplanes. In other situations, this step may represent a flight making a connection 

25 where the passenger does not deplane. In one example, ihe passenger may arrive at a 
Customs inspection station, and a Customs official may enter the passenger identifier 
into the remote access server, via, for example, an operator interface - step 536. This 
may also include scanning the barcode attached to the passenger's bag As mentioned 
above, this passenger identifier does not need to be a barcode, and maybe any unique 

30 identifier that ties the passenger to their baggage. 

The image file, threat file & passenger information may be retrieved by the 
remote access server and displayed at Customs checkpoint - step 538. Whether flie 
passenger is present or still on the plane (in the case of connecting flight), at some pomt 
the image (or some "go", "no go" result provided by a detection algorithm or an 
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operator) may be displayed for the arrival-side authority at their inspection point, hi 
one example, the image may be displayed twice, once to an operator who inspects the 
image for contraband, for example, while the flight is in the air on the way to the 
arrival-side authority, and a second tune, along with the operator's result when the 
5 passenger arrives at the inspection point 

Finally, m step 540, baggage may be either transferred directly to passenger's 
connecting flight, or made available for passengers to pick up. The disposition of the 
luggage may be automated based on flie detection algorithm or operator results. If a 
bag has not passed, the baggage handling personnel may locate the bag on an airplane 

1 0 based on the baggage identifier. Bags on a connecting Alight which have not passed 
mspection can be removed individually for further inspection. Furthermore, passengers 
whose luggage has not passed inspection may be mdividually asked to deplane. Bags 
which have passed inq>ection may be passed along to flieir next connecting flight 

The remote access server facilitates customer service via the ability to cause a 

1 5 change in state of a baggage screening machine through remote access to and operation 
on a network. Customer service representatives may run remote diagnostics through 
the server. The remote access server may provide a platform for developing and 
deploying new service appUcalions in the future. The remote access server may make 
both the system state and system data available, and allow both states of machines to be 

20 controlled and data constantly monitored without effecting the performance of a 
baggage screening netwoik. 

Further, the remote access s^er facilitates the use of automated means of 
optimizmg the operation of a baggage screening system. The server allows operations 
personnel access to information relating to manpower, system tibroughput, etc. The 

25 remote, access server allows operations personnel access to this data in an electronic 
format that can be directty imported into any number of analysis, data-mining, or 
operations automation software programs. 

It is to be ^predated that the system and methods disclosed herem maybe 
useful in many different appUcations and are not limited to the specific s^lications 

30 described herein. For example, the system and methods may be ^plied to baggage 

screening for domestic as well as intemational flights, to cargo as well as baggage, or to 
packages or any other items being transported firom one location to another. The 
sjrstem and methods may also be appUed to non-destmctive testing of components 
during manufacturing. In one example, an inspection machine may be used to obtain 
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an X-ray image of a component, and tfie component may mclude a unique identifier 
used to litik the component to the X-ray image. An remote operator may examine the 
image, or an algorithm may be implemented to examine the image, to detect whether 
the component has any defects. A r^ote access server may be used to control 
5 information transfer in this ^plication as was described above in reference to the 
baggage screening applications. 

Furthermore, it is to be appreciated that onbodiments and aspects of the 
invention may be executed on any suitable processor, such as processors within one or 
more computer systems, or a dedicated processor. Any single component or a 

10 collection of multiple components of the computer environment that perform any of the 
fimctions described above can generally be considered as one or more controllers that 
may form part of the remote access server and tiie operator interface. It is further to be 
appreciated that embodiments of the invention include a computer readable medium (or 
multiple computer readable media), such as, but not limited to, a computer memory, 

15 one or more floppy disks, compact disks, optical disks or magnetic tapes. The 

computer readable medium may be encoded with one or more computer programs that 
,when executed on one or more computers or other processors, performs methods that 
implement the various embodiments and aspects of the invention discussed above. The 
computCT readable medium may be transportable, such that the programs stored thereon 

20 may be loaded onto one or more computer systems, and may be distributed across a 
network, to implement various aspects of the invention as discussed above. 
AdditionaUy, the one or more computer programs that when executed perform methods 
of the present invention need not reside on a single computer or processor, but may be 
distributed in a modular fashion amongst a number of different computers or 

25 processors. 

Having thus described various illustrative, non-limiting embodiments and 
aspects thereoJ^ modifications and alterations wiU be apparent to those of skill in the 
art. Such modifications and alterations are intended to be included in this disclosure, 
which is for the purpose of illustration and explanation and not intended to define the 
30 limits of the invention. The scope of the invration should be determined from proper 
constmction of flie appended claims, and their equivalents. 

What is claimed is: 
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CLAIMS 

1. A system for remote baggage serening comprising: 

at least one baggage inspection system disposed at a first location and connected 
5 on a first subnet, the at least one baggage inspection system ad^ted to examine an item 
mider inspection and obtain infoimation about the item under inspection; 

an operator interface disposed at a second location remote firom the first location 
and connected on a second subnet, the operator interface being configured to receive 
the information about the item under inspection &om the at least one baggage 
10 inspection system and present the information for access by an operator; and 

a server coiq)led to the operator interface and to the at least one baggage 
inspection system, the server being adapted to control information transfer between the 
at least one baggage inspection system and the operator interface. 

15 2. The system as claimed in claim 1 , wherein the operator interface is fiirther 
configured to transmit instructions to the at least one baggage inspection system. 

3. The system as claimed in claim 1, wherein the first location is a first airport, and 
wherein the second location is a second airport. 

20 

4. The system as claimed in claim 1, wherein the at least one baggage inspection 
system includes at least one X-ray inspection machine. 

5. The system as claimed in claim 4, wherein the information about the item und^ 
25 inspection includes an X-ray image of the item under inspection. 

6. The system as claimed in claim 5, wherein the X-ray inspection machine is 
configured to focus an exammation of the item on a region of interest in the item under 
inspection. 

30 

7. The system as claimed in claim 1 , wherein the server is located on a same 
computing machine as the operator interface. 
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8. A system for baggage screening that is remotely monitored and controlled, the 
system comprising: 

a plurality of baggage inspection machines that obtain information about an 
item under inspection, each baggage inspection machine being coiq>led to a local 
5 network link; 

a storage medium, coupled to the local network link, that stores the information 
obtained by the plurality of baggage inspection machines; 

a controU^, coupled to the local network link, the controll^ being configured to 
retrieve the information about the item under inspection from the storage medium via 
10 the network link and to process the information to provide processed information; and 

an operator interface configured to receive the processed infoimation from the 
controller and to provide the processed information for inspection by an operator; 

wherein the operator interface is located remote from the plurality of baggage 
inspection machines and is coupled to the controller via a second network Unk; and 
15 wherein the item under inspection includes a unique item ID, the unique item ID 

being associated with the information to link the information to the item under 
inspection. 

9. The system as claimed in claim 8, wherein the second network link includes the 
20 Internet. , 

10. The system as claimed in claim 8, wherein the storage medium includes a database 
that stores the information about the item under inspection and the unique item IDs. 

25 11. The system as claimed in claim 8, wherein the plurality of baggage inspection 

machines includes at least one X-ray inspection machine that obtains an X-ray image of 
the item under inspection. 

12. The system as claimed in claim 1 1, wherein the information about the item under 
30 inspection includes the X-ray image. 

13. The system as claimed in claim 12, wherein the controller is adapted to process the 
X-ray image to identify a region of interest of the item under inspection. 
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14. The system as claimed in claim 13, wherein the processed information received by 
the operator interface includes an indication of the region of interest. 

15. The system as claimed in claim 8, wherein a transponder tag is attached to the item 
5 und^ inspection, the transponder tag including the unique item ID. 

16. The system as claimed in claim 8, wherein the item under inspection includes a 
barcode that includes the unique item ID. 

10 17. The system as claimed in claim 8, wherein the controller is ad^ted to employ a 
selected detection algorithm to process the information about the item under inspection 
to provide the processed information. 

18. The system as claimed in claim 17, wherein the operator interface is further adapted 
15 to receive an instruction from the operator and to provide the instruction to the 

controller; and wherein the controller selects a desired detection algorithm in response 
to receiving the instruction. 

19. The system as claimed in claim 8, wherein the pluraUty of baggage inspection 

20 machines are located at a first airport; and wherdn the operator interface is located at a 
second airport. 

20. A baggage screening system for remote screening of items under inspection, tiie 
baggage screening system comprising: 

25 a plurality of item files, each item file including a unique identifier that links the 

item file to an item under inspection; 

a database that stores the plurality of item files; 

an item file inspection device that receives at least one item file of the plurality 
of item files, analyzes the at least one item file and records screening information based 
30 on an analysis of the at least oiie item file, the screening information being linked with 
the at least one item file using the unique identifier; 

a server, coupled to the database and to the item inspection device, that retrieves 
the item files and the screening information linked with the item files responsive to an 
input; and 
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an operator interface, coupled to the server, that provides the iiq)ut to the server 
and receives the pliirality of item files and associated information fix>m the server. 

21. The baggage screening system as claimed in claim 20, wherein the operator 

5 interface is adapted to display the plurality of item files and tiie associated information 
for inspection by an operator 

22. The baggage screening system as claimed in claim 21, whorein the operator uses the 
item files and flie associated information to remotely screen items under inspection. 

10 

23. The baggage screening system as claimed in claim 20, wherein each item file 
includes data corresponding to an X-ray image of the item under inspection. 



24. The baggage screening system as claimed in claim 23, wherein the item file 

15 inspection device is adapted to analyze the item file according to a detection algorithm 
to identify a region of interest in the X-ray image of the item under inspection. 

25. The baggage screening system as claimed in claim 20, wherein the associated 
information includes a digital photogr^h of a passenger linked with flie item under 

20 inspection. 

26. The baggage screening system as claimed in claim 20, wherein the associated 
information includes a passport number of a passenger linked with the item under 
inspection. 

25 

27. The baggage screening system as claimed in claim 20, wherein the associated 
information includes a nationality of a passenger linked with the item under inspection. 

28. A system for r^ote inspection of items, the system comprising: 

30 at least one inspection machine constructed to examine an item under inspection 

to obtain information about the item under inspection; 

a database coupled to the at least one inspection machine, the database being 
adapted to receive the information about the item under inspection from the at least one 
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inspection machine and to store the information in an item file, the item including a 
unique item identifier; 

an item file inspection device that receives the item file, analyzes data contained 
in the item file and records screening information based on an analysis of the item file; 
5 and 

a server, coupled to the database and to the item file inspection device, the 
server being adapted to control transfer of the item file firom the database to the item 
file inspection device, and transfer of the screening information firom the it^ file 
inspection device to the database; 
10 wherein the screening information is linked with the item file using the unique 

item identifio:, and wherein the database is fiirther adapted to store the screening 
information; and 

wherein the item file inspection device is located remote from the at least one 
inspection machine. 

15 

29. The system as claimed in claim 28, wherein the item inspection device includes a 
detection algorithm. 

30. The system as claimed in claim 28, finlher including an operator interface, coupled 
20 to the server, the operator interface being adapted to receive the screening information 

and to display the screening information; and wherein the server is adapted to control 
transfer of the screening information between the database and the operator inter&ce. 
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